Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | See parent post | Go Back
View Post [edit]

Poster: KlangenFarben Date: Jul 6, 2012 6:41pm
Forum: web Subject: Re: Do crawls get deleted?

I can certainly attest to the phenomena of previously available TWBM crawls that became unavailable sometime in the past year or two. I launched TheSoftwareMills.com in late November 2008, and shortly thereafter subscribed to web.archive.org's crawl list. By 2010 there were at least three crawls, but currently there's a single crawl that's sixteen months old; not much has changed since then (mostly deletions), suggesting some heuristic was at work. I'm not challenging Anamon's account but rather relating my perception of how TWBM works.

Anamon second paragraph does accurately reflect what happened to the once-well-crawled sybarite.com, which I operated for three years or so 1997-1999 and perhaps later. When I first heard of TWBM around 2004-2006, I immediately checked sybarite.com and was astonished to find at least three and perhaps as many as six crawls. The removal request is clear, but as I am a data hoarder I posted a copy of the old sybarite.com site on my current site, so--outside of loss of proof of previous ownership--no harm done, and clearly no complaints as I've never been asked much less assisted with TWBM.

At any rate, it's Good To Know some of the inner workings of TWBM.

cheers klang

Terms of Use (10 Mar 2001)